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Abstract 

Given two subsets A and B of nodes in a directed graph, the con- 
duciveness of the graph from yl to _B is the ratio representing how many 
of the edges outgoing from nodes in A are incoming to nodes in B. When 
the graph's nodes stand for the possible solutions to certain problems 
of combinatorial optimization, choosing its edges appropriately has been 
shown to lead to conduciveness properties that provide useful insight into 
the performance of algorithms to solve those problems. Here we study the 
conduciveness of CA-rule graphs, that is, graphs whose node set is the set 
of all CA rules given a cell's number of possible states and neighborhood 
size. We consider several different edge sets interconnecting these nodes, 
both deterministic and random ones, and derive analytical expressions for 
the resulting graph's conduciveness toward rules having a fixed number 
of non-quiescent entries. We demonstrate that one of the random edge 
sets, characterized by allowing nodes to be sparsely interconnected across 
any Hamming distance between the corresponding rules, has the poten- 
tial of providing reasonable conduciveness toward the desired rules. We 
conjecture that this may lie at the bottom of the best strategies known 
to date for discovering complex rules to solve specific problems, all of an 
evolutionary nature. 

Keywords: Cellular automata. Rule space. Complex rules, Network con- 
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1 Introduction 



Ever since Wolfram first introduced his four-class qualitative categorization of 
elementary cellular automata (CA) 19 , the problem of distinguishing CA up- 
date rules in quantitative terms within both his classification scheme and others 
(e.g., [121 13]), with the special aim of identifying the so-called complex rules, 
has been a central one [351 HI HOI dH] • Some of the notable approaches have been 
Langton's edge-of-chaos parameterization of the rule space (through the frac- 
tion, denoted by A, of "non-quiescent" entries in a rule) [HI [13] and Wuensche's 
input entropy (through estimates, along traces of CA evolution, of the rate at 
which the various rule entries are used) [2T1|2]. Despite criticism (e.g., [T4]). 
these two approaches have remained emblematic because they have brought im- 
portant insight into the problem while occupying fundamentally different niches: 
while the former attempts quantification by focusing on static properties of the 
rule in question, the latter focuses on the rule's dynamic response over time. 

The larger issue, of course, is the identification of complex rules that display 
specific patterns of behavior or solve specific problems, and in this regard all 
classification-related quantifications seem to have had little impact. At bottom, 
what really is behind the search for specific complex rules is an intricate problem 
of combinatorial optimization that can easily become unmanageable as the cells' 
possible states go beyond the binary case or their neighborhoods get larger (ei- 
ther with the addition of extra dimensions or otherwise). Not surprisingly, then, 
so far the success cases have all harnessed nature-inspired stochastic methods, 
particularly those of evolutionary inspiration [TH [S] [T71 13] , to navigate the rule 
space. 

The use of "navigate" here is very appropriate because it evokes with great 
clarity what combinatorial-optimization methods do, which is precisely to move 
in a seemingly unstructured solution space seeking its optima. There is struc- 
ture, however, at least insofar as the method's optimization strategy can be 
said to establish a relationship among the possible solutions as it moves from 
one to another. There is also a more elemental type of structure connecting 
the various solutions together, generally related to transforming one solution 
into another by means of some simple alteration. Although this latter structure 
need not be related to any given algorithm's navigation of the solution space, 
for some problems it has been shown to provide the solution space with cer- 
tain "conduciveness" characteristics that do nevertheless affect that algorithm's 
performance 1 . 

The problems in question are those of coloring an undirected graph's nodes 
optimally and of finding one of the graph's largest subsets of nodes that only 
contain non- neighbors (a so-called maximum independent set), both compu- 
tationally difficult in the sense of NP-hardness. For these two problems, an 
underlying structure unrelated to the best existing heuristics has been shown to 
account for intriguing performance transitions that are known to occur as the 
graph's size changes. Specifically, right before such a transition it is significantly 
harder to solve the problem than right past it. What happens at the transition 
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is that the aforementioned underlying structure suddenly becomes much more 
conducive from nonoptimal to optimal solutions. 

The notion of conduciveness we refer to is precise and can be formalized 
as follows U. Let D be a directed graph whose nodes stand for solutions to 
the optimization problem at hand and whose edges reflect the said underlying 
structure. Given two node subsets, call them A and B, the conduciveness of 
D from A to i? is the fraction of edges that, out of all those that are outgoing 
from a node of A, are incoming to a node of B. Put differently, if m{A) is the 
number of edges whose tail nodes are in A, and m{A, B) is the number of edges 
with tail nodes in A and head nodes in B, then the conduciveness of D from 
A to -B is Tn{A, B) / m{A) . Conduciveness, then, is necessarily a number in the 
[0, 1] interval, since every edge counted in m{A, B) is also counted in m{A). In 
the two examples mentioned above, A and B partition the node set of D and 
stand, respectively, for nonoptimal and optimal solutions to the optimization 
problem being considered. 

Here we examine the rule space of CA from the standpoint of some directed 
graphs that can be viewed as providing an underlying structure interconnecting 
all possible rules. As in the case of the graph problems mentioned above, such 
structures need not have anything to do with possible algorithms to find specific 
rules. Instead, we study their conduciveness properties in search for some hint 
as to why evolutionary approaches to discover specific complex rules have suc- 
ceeded while others have barely been attempted. Our conclusions will point at 
certain random structures whose expected conduciveness foreshadows the exis- 
tence of deterministic structures with the potential of being at least reasonably 
conducive. 

Of course, analyzing any graph's conduciveness requires a precise definition 
of sets A and B. In the case of CA this can be really tricky. Say, for example, 
that we are looking for a complex rule to solve a specific problem. Sets A 
and B might then be defined as a function of some quantitative description of 
how well each possible rule solves that problem. This would amount to simply 
carrying over, to the context of CA rule space, the very same simulation-based 
approach that was used in the graph-coloring and independent- set problems 
mentioned above. While we had success in those cases, mainly because scaled- 
down versions of the problems still exhibit the same transition phenomena we 
wished to explain, nothing of the sort is expected to happen in the case of CA. 
In other words, we would be left with impossibly large rule spaces and would 
never be able to characterize conduciveness properly. 

The alternative we adopt in this paper is to settle for some characterization of 
the rule space which, while retaining the ability to relate to a rule's "complexity" 
to some extent, is also amenable to an analytical portrayal of conduciveness 
that can be used in lieu of computer simulations. The advantage, clearly, is that 
entire rule spaces can be examined, at least in some nontrivial cases. Our choice 
has been to use Langton's A parameter, so rules in set B are characterized by 
having the same number of non-quiescent entries. Set A is then the complement 
of B with respect to the entire rule space. The disadvantage we have to cope 
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with is, naturally, the loss in power to describe complexity that has been an 
issue also in Langton's approach. 

We proceed in the following manner. First we introduce, in Section [21 the 
CA-rule graphs to be studied. Then we derive analytical expressions for their 
conduciveness in Section [3] and study them with the aid of selected plots in 
Section |31 We discuss the most relevant properties and finds in Section [S] and 
conclude in Section [6] 

2 CA-rule graphs 

We consider CA in which a cell's state is one of the integers in {0, 1, . . . , s — 1} 
for some s > 2. We assume that the cell's neighborhood, including the cell 
itself, has size 5 for some 5 >2. It follows that the rule governing the behavior 
of the CA can be regarded as an L-entry table for L — and that the number 
of possible rules is s^. Cells may be arranged with respect to one another 
one-dimensionally or otherwise, as this is of no concern to what follows. 

We focus on the directed graph having one node for each possible rule and 
edges that join nodes according to one of three criteria. Two of them are 
deterministic and result in an edge existing from one node to another if and 
only if that edge's antiparallel counterpart also exists. Using an undirected 
graph instead would then be entirely acceptable, but we refrain from doing so 
to adhere to the definition of conduciveness and to maintain compatibility with 
the third, probabilistic criterion. 

The first criterion joins two nodes if and only if the corresponding rules differ 
in exactly one entry (i.e., if the Hamming distance between them is exactly 1). 
This is the case of the traditional hypercube, which we denote by H. In H every 
node has exactly L{s — 1) out-neighbors. The second criterion generalizes the 
first one by allowing two nodes to be joined if and only if the Hamming distance 
between the corresponding rules is exactly h for some h > 1. The resulting 
graph is a generalized hypercube, here denoted by H'^ . In every node has 
(^) (s — 1)^ out-neighbors, since this is the number of ways in which its rule can 
be modified by altering exactly h entries. 

The third criterion to define the graph's edge set is to allow any two nodes to 
be joined probabilistically to each other as a function of the Hamming distance 
between their rules. This is done independently for each of the two possible 
directions, so two nodes need no longer be joined by an antiparallel edge pair. 
The result is a random-graph model of the interconnections among the rules. 
This random graph is denoted by and depends on a probability parameter, 
call it p. In H'^ an edge exists from a node to another with probability p'^, 
where h is the Hamming distance between the nodes' rules. That is, although 
any Hamming distance is allowed between the rules of two nodes joined by 
an edge, higher Hamming distances make it exponentially less likely that the 
edge indeed exists. For fixed h > I we expect a node to have p^['j^){s — 1)'' 
out-neighbors separated from it by a Hamming distance of h, so overall the 
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expected number of a node's out-neighbors is 

|^^(^^)[p(s-l)]" = [p(s-l) + l]^-l. (1) 

For each of H ^ and , and for each I such that < ^ < L, we partition 
the graph's node set into the two sets A and B, the latter containing all (and 
only) nodes whose rules have exactly ^ non-quiescent entries. It follows that B 
comprises (^) (s — 1)^ nodes. We then calculate each graph's conduciveness from 
set A to set B, denoted respectively by C^, C^, and C^. Owing to the random 
nature of , is the expected conduciveness from Ato B. 



3 Conduciveness formulae 



We begin with the hypercubc H . In this case the total number of edges outgoing 
from nodes in set A is the product of the set's cardinality and the number of 
out-neighbors of each of its nodes, that is, [s^ — (^(){s — l)^]L(s — 1). Some of 
these edges are incoming to nodes in set i?, belonging to one of two categories. 

Edges in the first category outgo from nodes of A whose rules have exactly 
one non-quiescent entry too few when compared to those of B, provided £ > 0. 
The number of such nodes is (^^j)(s — l)^"'^, each one accounting for {L — t + 
l)(s — 1) S-bound edges, since s — 1 is the number of possibilities to turn each 
of the L — i + 1 quiescent entries into a non-quiescent one. The second category 
of B-bound edges comprises edges outgoing from nodes in A that have exactly 
one non-quiescent entry too many with respect to B, provided £ < L. There are 
— 1)^^^ such nodes, each one contributing ^-|- 1 to the total of B-bound 
edges, this being the number of non-quiescent entries, each affording one single 
possibility to be turned into a quiescent one. It then follows that Cg is given by 
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L 



{s-lY 



(2) 



L{s - 1) 



where each of 5i^q and (5£<l equals 1 if the corresponding inequality holds, 
otherwise. 

As we move to the generalized hypercube the number of edges outgoing 
from nodes in A becomes [s^ — (^) (s — 1)^] (^) [s — 1)'*, and we are left with the 
task of calculating how many of them are incoming to nodes in B. Again we 
categorize these edges as a function of their end nodes on the A side, but now 
we require a nonnegative integer parameter, call it fc, to proceed. 

Each value of k corresponds to nodes in A whose rules have exactly £ — h + 2k 
non-quiescent entries, and consequently L—£+h — 2k quiescent entries (provided 
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k 7^ h/2, in which case we would have a B node, not an A node). Simultaneously 
altering h entries, k of them from non-quiescent to quiescent and the remaining 
h — k from quiescent to non-quiescent, clearly leads to a node in B, since the 
number of non-quiescent entries is thus changed to £ by the subtraction of 
k — {h — k) off the original value, £ — h + 2k. We denote the number of such 
nodes in A by /(fc), therefore 



f{k) = 



L 



2k 



(,s-l) 



e~h+2k 



(3) 



Each of these nodes allows for ('^ ^'') 'jj^^'') possibilities to effect the said 
alterations, each possibility accounting for (s — 1)'*^'= S-bound edges. Denoting 
by g{k) the overall number of B-bound edges outgoing from a given node in A 
yields 



9ik) = 
We then have 



L-t + h-2k 
h-k 



e-h + 2k 



i.s-1) 



h-k 



(4) 



min{h.L-e} 

E 

k=nia.x{0,h-e] 
k^h/2 



f{k)g{k) 



(5) 



where the possible values of k are carefully controlled to account for the forbid- 
den cases oi k ^ [0, h] and k = h/2. Note, incidentally, that letting h — 1 causes 
the numerator of Eq. ([5|) to have at most two summands, one for fc = and one 
for /c = 1, in such a way that /(0)(?(0) and /(l)g(l) are precisely the summands 
in the numerator of Eq. respectively the leftmost one and the rightmost. 

In the case of the random graph i/'', the expected number of edges outgoing 
from nodes in set A is [s^ - (^)(s — l)^]{[p(s - 1) + 1]^ - 1}. We calculate how 
many of these edges are expected to be i?-bound by simply summing up, on h, 
the corresponding number we found in the case of the generalized hypercube 
(i.e., for the fixed Hamming distance h). In this sum every edge is weighted 
by the probability p'* that defines its existence. We obtain 

L min{/i,L-f} 

^/ ^ f(k)g{k) 

h=l k=nia.x{0.h-e} 
k^h/2 



CI 



{b( 



(6) 



s-l) + ll"-l 



Note that, in the limit as p -> 0, C} tends to for h ~ 1, that is, the 
conduciveness Ci of the hypercube H. To see this, first notice that, as the limit 
is approached, the only value of h still contributing to the numerator of Eq. ^ 
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is h = 1. The resulting simplification leads to Eq. ^ through Eq. once we 
realize that 

limifcll±^ = L(.-l). (7) 



4 Conduciveness plots 

In this section we present plots of the hypercube conduciveness Ci, the con- 
duciveness of the generalized hypercube, and the random-graph conducive- 
ness C^, as per Eqs. ©, ([S]), and ([5]), respectively. In all plots we normalize the 
abscissae to lie in the [0, 1] interval by plotting the conduciveness values against 
A = £/L, the Langton parameter. 

Conduciveness values can be extremely low, depending on the parameters 
involved, which requires some care in both handling the generation of the data to 
be plotted and the plotting itself, and even so constrains the parameter values 
that can be used. We have used a C program to generate the data as long 
double numbers (96-bit numbers for gcc-4.4.6-3) and gnuplot-4.2.6-2 to 
do the actual plotting. As gnuplot-4 . 2 . 6-2 does not appear to handle numbers 
of the same precision as those we generated via gcc-4 . 4 . 6-3, and also to avoid 
the use of an automatic logarithmic scale while plotting (we think this facilitates 
reading figures off the plots), a conduciveness value c is output as LL(c) = 
logiQ(— logiQ c) for plotting. That is, reading an ordinate LL(c) = y off a plot 
implies a conduciveness value c = 10"^'' . 

Plots for are shown in Figures [1] and [2] for s — 2 and s — 3, respectively, 
and a variety of 6 values. Plots for are given in Figures [3] and HI respectively 
for s = 2 and s = 3 as well, now for S fixed at S = 7 with a variety of h 
values. Plots for appear in Figures [5] and [6l once again for s = 2 and s = 3, 
respectively, again for 6 = 7 but now varying p. All three figures corresponding 
to the same value of s have one plot in common: the Ci plot for S = 7, which 
is the same as the plot for 6 = 7 with h = 1, which in turn is visually 
indistinguishable from the plot for 6 = 7 with p = 0.0001 (by virtue of the 
limit given in Eq. (O). For ease of reference, note that the integer ordinates 0, 
1,2, and 3 appearing in all figures correspond to conduciveness values of 10~^, 
10-1", 10-1"", and 10-1""", respectively. 



5 Discussion 

One common term in all of Eqs. (H]), ([S]), and ^ is the number of nodes whose 
rules contain exactly £ non-quiescent entries, given by {j){s — 1)^. It is easy to 
prove that this number is maximized by choosing £ = £* , where 



L \ s 



(8) 



which is precisely the probability of picking a non-quiescent entry in a rule where 
all s values are equally represented. In his analysis of elementary C A [TTJ [22] , 
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Figure 1: Conduciveness Ci of the hypercube _ff for s = 2. Data are given 
against A = IjL. 
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Figure 2: Conduciveness Ct of the hypercube H ior s = 3. Data are given 
against X ^ i/L. 
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Figure 5: Expected conduciveness of the random graph for s = 2 and 
6 = 7. Data are given against A = £/L. 
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Figure 6: Expected conduciveness of the random graph H'^ for s = 3 and 
6 = 7. Data are given against X = £/L. 
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Langton associated the resulting A* = /L with the occurrence of chaotic 
behavior. Moreover, deviating from the optimal value to either side might lead 
to complex rules and eventually to trivial fixed points and limit cycles. 

As it happens, it can also be proven that setting £ = £* maximizes Ci as 
well. This is illustrated clearly in Figures [T] and [5J where A* = 0.5 in the 
former case and A* = 2/3 in the latter, regardless of the value of 6. Thus, if 
Langton's scheme were to hold as originally proposed, the hypercube H would 
be much more conducive to chaotic-rule nodes than to those of rules leading to 
fixed points or limit cycles, with the conduciveness to complex-rule nodes lying 
somewhere in between. 

Figures [T] and [5] also reveal that, for fixed 5, the value of Ci falls quickly as £ 
is moved to either side of its optimal value, £*. In fact, this fall eventually leads 
to staggeringly low conduciveness values for the higher values of d. Curiously, 
though, for £ = £* the decrease in d for increasing 5 seems headed toward a 
limiting value. However, this can be seen to be illusory by examining the case 
of s = 2 (thus £* — L/2 = 2"^"^). In this case, we can rewrite Ci» as 

^2^-1 = J , (9) 



2<5-i 

whose limit as (5 -t- oo is infinity. 

The generalized hypercube , to which Figures |3] and 0] refer, represents 
an attempt to increase a node's number of out-neighbors in the graph from the 
L{s — 1) out-neighbors that it has in the hypercube H to (^)(s — 1)'' for h > 1. 
This increase is not steady with h, though: as in the characterization of £* 
above, this number of out-neighbors peaks at h — L(l — 1/s) and then decreases 
as h continues to grow toward h = L. 

In any event. Figures [3] and H] indicate that does not improve with respect 
to Ci by simply increasing the Hamming distance between the rules of two 
interconnected nodes. On the contrary, as s is increased from 2 to 3 we see that 
conduciveness values worsen dramatically as h is increased, in a clear indication 
that h = 1 remains the best choice. We also remark that, although for s = 3 the 
lowering of values occurs monotonically with the increasing of h, the case 
of s = 2 is altogether different. Specifically, all values are confined between 
those for h = 1 and h = 2, with those for odd h coinciding with those oi h = 1 
and those for even h increasing steadily toward those of /i = 1 as well (this can 
be seen more clearly in the inset to Figure [3|) . 

Similar observations apply to the random graph ' . Note initially that here 
too there has been an attempt to increase a node's number of out-neighbors 
in the graph, though in the sense of probabilistic expectation and allowing 
a random mixture of Hamming distances between a node's rule and those of 
its out-neighbors. In fact, this expected number of out-neighbors, given by 
\p{s — 1) + 1]^ — 1, can be seen to increase steadily with increasing p. However, 
increasing the expected number of out-neighbors of a node does not contribute 
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to improve the behavior of C^, whose values are seen to fall precipitously as p is 
increased for s = 3 (of. Figure [6]). The case of s = 2, shown in Figure [Sj is sort 
of an oddity, with all conduciveness values confined between those for a very 
low value of p and those for about p = 0.02. We show no further plots than 
those of these constraining values of p to avoid cluttering the figure, but remark 
that first decreases as p is increased from p — 0.0001, then increases back 
toward its initial value after p = 0.02 is reached. 

It might then seem like the best conduciveness is provided by graph H, the 
hypercube, since > for any value of h and Ce > CI for any value of p. 
The caveat, of course, is that the latter inequality requires careful interpretation, 
since CI is the expected conduciveness of all graphs modeled by the random 
graph iJ'', not the conduciveness of a specific graph. The graphs to which 
the expected value refers include any graph one may come up with, because 
if allows edges to exist between any two nodes, in any of the two possible 
directions, regardless of the Hamming distance between their rules. This means 
that the conduciveness distribution to which the expected value refers, although 
unknown, spreads toward lower conduciveness values very widely, as shown in 
Figure |6] for s = 3. The inescapable conclusion is that H'' also models graphs 
whose conduciveness is higher than Cg. All we know about these graphs, though, 
is that they allow mixed Hamming distances between interconnected nodes' rules 
to coexist and that the best improvements in conduciveness should occur for low 
values of p. 

Allowing diverse Hamming distances to occur in the same graph is more of a 
key property of H'^ than it may at first seem. To see that this is so, let us consider 
another random- graph model, viz. a directed variation of the Erdos-Renyi model 
[II [9] , henceforth referred to as DER. In this model, an edge exists between any 
two distinct nodes, in each of the two possible directions, independently with 
probability p. In our setting this leads to an expected number of out-neighbors of 
p(s^ — !)• The expected conduciveness of the DER model can be obtained from 
that of H'' in Eq. © by substituting p for p'^ in the numerator and p{s^ — 1) for 
[p{s — 1) -|- 1]^ — 1 in the denominator. The resulting expression is independent 
of p, being in fact identical to CI ior p = 1. The latter, of course, is precisely 
the special case of that is no longer a random graph but the complete graph 
instead, that is, the graph in which every node has every other node as an 
out-neighbor. So, although the DER graph also allows for conduciveness values 
that spread around the expected value and in fact encompass the conduciveness 
of any other graph, this expected value is as bad as the conduciveness of 
for p = 1. Therefore the two random-graph models, for low values of p and 
DER, have expected conduciveness values corresponding to the upper and lower 
conduciveness extremes of Figure IHl respectively. 

6 Conclusions 

Applying the notion of a graph's conduciveness when the graph's node set is 
the solution space of some combinatorial problem and its edge set reflects some 
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elemental relationship among the various solutions is a technique for discovering 
whether the graph possesses some inherent property that explains the behavior 
of algorithms to search for specific nodes in it. The idea is very new, dating 
from its first use in |T], so it is no surprise that we have little more than a phe- 
nomenological understanding of how conduciveness relates to search algorithms 
that in general use totally different sets of edges while seeking nodes belonging 
to a particular set, say B. One tantalizing interpretation is that, as such an 
algorithm traverses the node set, occasionally the two edge sets will coincide 
and, if the graph is conducive toward B from outside B, then the possibility of 
reaching B presents itself. 

The study contained in [T] seems to support this interpretation, and so does 
the present one, which has been about traversing the rule space of CA searching 
for some degree of complexity which, for the sake of permitting an analytical 
formulation of conduciveness in all graph types investigated, we assumed to be 
related to the rules' density of non-quiescent entries. Our main conclusion has 
been that a sparse random-graph topology allowing nodes to be interconnected 
regardless of the Hamming distance separating the rules they stand for has 
the potential of providing reasonable conduciveness toward the desired rules, 
particularly if these rules' number of non-quiescent entries is located not too 
far from L{1 — 1/s) in the sequence 0,1,..., L. We think this may be well 
in line with the success of some evolutionary approaches in locating complex 
rules to solve specific problems: though the recombine/mutate essence of such 
approaches leads them to follow routes of their own through rule space, its 
stochastic character is bound to allow for successful jumps into set B whenever 
the expected conduciveness is sufficiently high. 

We finalize by noting that conduciveness studies like this one also constitute 
a link between the study of CA and that of the so-called complex networks, 
which over the past decade have been applied so successfully to such a wide 
range of domains as reported in O [TH |4] . As demonstrated by the recent study 
in [TU], the field of artificial life has much to gain from the broadly applicable, 
essentially stochastic tools that researchers on complex networks have amassed 
for the analysis of very large ensembles of interconnected elements. Our study 
of the conduciveness of CA-rule graphs constitutes another example. 
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